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*0, ' Abstract 

(N ; 

We study the representation theory of the rook-Brauer algebra RBfc(x), which has a of Brauer 
j" | diagrams that allow for the possibility of missing edges. The Brauer, Temperley-Lieb, Motzkin, 



rook monoid, and symmetric group algebras are subalgebras of RB/ £ (a;). We prove that RBfe(n+l) 
is the centralizer of the orthogonal group 0„(C) on tensor space and that RBfe(n+ 1) and 0„(C) 
are in Schur-Weyl duality. When x € C is chosen so that RBfe(x) is semisimple, we use its 
Bratteli diagram to explicitly construct a complete set of irreducible representations for RBfc(x). 

Keywords: Brauer algebra, rook monoid, orthogonal group, Schur-Weyl duality, seminormal rep- 
resentation. 



1 Introduction 



> 

t> 
in 

For k > and x £ C, the rook-Brauer algebra R&k{ x ) is an associative algebra with 1 over 
C with a basis given by rook-Brauer diagrams — these are Brauer diagrams in which we may 
remove edges — and a multiplication given by diagram concatenation. The rook-Brauer algebra 
contains the symmetric group algebra, the rook monoid algebra [So], the Brauer algebra [Br], the 
Temperley-Lieb algebra |TLj , the Motzkin algebra [BHj , and the planar rook monoid algebra [FHH] 
as subalgebras. 

In this paper, we define an action of RB^(n + 1) on tensor space V® fc where V has dimension 
n + 1 with basis vq,vi, . . . ,v n , and we show that this action is faithful when n > k. We then 
consider V = V(0) © V(l) where V(0) = C-span{t>o} is the trivial module for the orthogonal group 
n (C), and V(l) = C-span{i>i, . . . ,v n } is the defining n-dimensional module for n (C). Then V® fc 
is a fc-fold tensor product module for O n (C). We prove that the actions of RBfe(n + 1) and n (C) 
commute on V® fc and that, 

RB k (n + 1) End 0n ( C )(V® fc ), when n > k. 

Thus, RBfc(n + 1) and ra (C) centralize one another and are in Schur-Weyl duality on V® fc . 

Using this duality, we are able to show that for generic values of x G C, RBfc(x) is semisimple. 
Double centralizer theory and the combinatorics of the irreducible O n (C) modules which appear 
in V® fe tell us that the irreducible RB^(n + 1) modules are indexed by integer partitions A h r for 
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< r < k. Furthemore, dimension of these irreducible modules are given by paths in the Bratteli 
diagram, which are closely related to the vacillating tableaux studied in [HRJ and [CDDSY]. 

In Section 4 of this paper we explicitly construct the irreducible RBfc(x)-modules for x £ C such 
that RBfc(x) is semisimple. These modules have a basis indexed by paths in the Bratteli diagram, 
and we give an action of the generators on this basis. Our action is a generalization of Young's 
seminormal action of the symmetric group on standard Young tableaux. We use the analogous 
seminormal representations of the Brauer algebra |Nzj . |LR| and of the rook monoid algebra [Haj 
in our construction. 

The rook-Brauer algebra was first introduced in |GrWj . and it is also studied in |Mzj . The 
monoid of rook-Brauer diagrams (called the partial Brauer monoid) is examined in [KM], where 
it is given a presentation on generators and relations. Representations of the rook-Brauer algebra 
are studied independently (and simultaneously with this work) by Martin and Mazorchuk [MMJ 
using different methods. Martin and Mazorchuk also derive the Schur-Weyl duality between O n (C) 
and RBfc(n). They define an action of the generators on tensor space and verify that the defining 
relations are satisfied. Our approach is different in that we give the action of an arbitrary rook- 
Brauer diagram on tensor space and use the diagram calculus to prove that it is a representation 
(see Proposition 13.14]) . Furthermore, Martin and Mazorchuk |MM| construct Specht modules for 
the (integral) rook Brauer algebra, which correspond to a complete set of irreducible RBfc(x) mod- 
ules over C in the semisimple case. These are different from, but isomorphic to, the seminormal 
representations given in Section 4 of this paper. 

The Schur-Weyl duality results in this paper form the bulk of the work in the first author's 
2012 honors thesis [dM]. The ideas behind this paper began long ago in conversations between 
the second author, Georgia Benkart, and Cheryl Grood. It was to become a paper, "BMWISH 
Algebras" (Birman-Murakami-Wenzl-Iwahori-Solomon-Hecke Algebras), which was never written. 
We thank the anonymous referee for several helpful suggestions. 



2 The Rook Brauer Algebra RBk(x) 
2.1 Rook-Brauer diagrams 

A rook-Brauer k- diagram is a graph consisting of two rows each with k vertices such that each 
vertex is connected to at most one other vertex by an edge. We let TZB\~ denote the set of all 
rook-Brauer A;-diagrams, so that for example, 




10 



and 



I I, 4 », I •, a I, »^», * », 



The rook-Brauer /c-diagrams correspond to the set of partial matchings of {1,2,... ,2k}. Rook- 
Brauer diagrams consist of vertical edges which connect a vertex in the top row to a vertex in the 
bottom row, horizontal edges which connect vertices in the same row, and isolated vertices which 
are not incident to an edge. We can count the number of rook-Brauer diagrams of size k according 
to the number £ of edges in the diagram. First choose, in (^) ways, the 2t vertices to be paired by 
an edge, and then connect these vertices in (2^)!! = (21 — 1)(2£ — 3) • • • 3 • 1 ways. Thus 
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so that the first few values are 1, 2, 10, 76, 764, 9496, 140152, 2390480, 46206736, 



2.2 The rook-Brauer algebras RBk(x,y) and RBk(x) 

We follow [Mz] and first define a two parameter rook-Brauer algebra RB k (x,y). We then specialize 
to the one-parameter algebra RB k (x) = RB^(x, 1). Assume K is a commutative ring with 1 and that 
x and y are elements of K. Set RBo(x,y) = Kl, and for k > 1, let RB/ ( .(x,y) be the free K-module 
with basis the rook-Brauer fc-diagrams TiB^. We multiply two rook-Brauer ^-diagrams d\ and d 2 
as follows. Place d\ above d 2 and identify the bottom-row vertices in d\ with the corresponding 
top-row vertices in d 2 - The product is 

d x d 2 = x< dl ' d ^y< dl ' d2 U 3 (2.2) 

where d 3 is the diagram consisting of the horizontal edges from the top row of d%, the horizontal 
edges from the bottom row of d 2 , and the vertical edges that propagate from the bottom of d 2 to 
the top of d%, n(di,d 2 ) is the number of loops that arise in the middle row, and e{d\,d 2 ) is the 
number of isolated vertices that are left in the middle row. For example, if 



then 




Diagram multiplication makes RB k (x,y) into an associative algebra with identity element = 

1 1 1 : : : 1 1 

Under this multiplication, two vertical edges can become a single horizontal edge as in the 
example above, and a vertical edge can contract to a vertex. The rank of a diagram rank(d) is 
the number of vertical edges in the diagram. Therefore, rank^icfe) < min(rank(di), rank^)). For 
< r < k, we let J r (x,y) C RBk(x) be the K-span of the rook-Brauer /c-diagrams of rank less 
than or equal to r. Then J r (x,y) is a two-sided ideal in RBfc(x) and we have the tower of ideals, 
JoO,y) C h(x,y) C J 2 (x,y) C • • • C J fc (x,y) = RB k (x,y). 

Under multiplication in the partition algebra Pfc(x) defined in |Ma| and [Joj isolated vertices 
and inner loops are treated the same. Thus, it is possible to view the rook-Brauer algebra RB^(x, y) 
as a subalgebra of the partition algebra Pk(x) by setting the two parameters equal to one-another; 
specifically, RBfc(x,x) C Pfc(x). For the Schur-Weyl duality between the rook Brauer algebra and 
the orthogonal group in Section 3, we want to specialize the second parameter to y = 1. For this 
reason, we consider the one-parameter rook-Brauer algebra 

RB fe (z) = RB k (x, 1). (2.3) 

2.3 Subalgebras 

A number of important diagram algebras live in RB^(x) as subalgebras (we use RB^(x) instead 
of RB/u(x,y) since each subalgebra either has no isolated vertices or requires that y = 1). Rook- 
Brauer fc-diagrams having k edges are Brauer diagrams, and their IK-span is the Brauer algebra 
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Bfc(x). The set of diagrams of rank k is the symmetric group and their C-span is the symmetric 
group algebra KS&. The set of diagrams with no horizontal edges is the rook monoid and their 
span is the rook monoid algebra ICR^. Finally, a rook-Brauer diagram is planar if can be drawn 
within the rectangle formed by its edges without any edge crossings. The planar Brauer diagrams 
span the Temperley-Lieb algebra TL k (x), the planar rook-monoid diagrams span the planar rook 
monoid algebra PR/t, and the planar rook-Brauer diagrams span the Motzkin algebra M k (x). An 
example of a diagram from each of these subalgebras follows: 



e Sio 
e Rio 

G PRlO 













XI//IXI 



2.4 Generators and relations 

For 1 < i < k — 1 define the following special elements of RBfc(x) 

12 i-l i i+li+2 k 12 

-= I i:::i X i:::i and *= 1 1 

and for 1 < % < k define 

12 i-l i i+li+2 k 

It is easy to verify that these diagrams generate all of RBfc(x). In fact, RB/^a;) can be generated 
by Pi, ii and s\, . . . , s n _i- Furthermore, our subalgebras are generated as follows, 

B fe (x) = (si,...,s fc _i,ti,...,t fc _i) KR fc = (pi, . . . ,p k ,sx, . . . ,Sfc_i) 

KS fc = (si,...,s fc _i) KPRfe = (pi, . . . ,p fc ,4, • • • ,4-i,H, • • • ,r k -i) 

TL fc (x) = (ti,...,t fc _i) M fc (x) = (ti,...,t fc „i,£i,...,4_i,ri,...,r fe _i) 

where, for each 1 < i < k — 1, we let li = SiPi and r\ = PiSi. 

A presentation of RB^x) is given in |KMj which we describe here. The symmetric group 
Sfe C RBfc(x) is generated by Sj for 1 < i < k — 1 subject to the following relations: 

(a) sj = l, 1 < * < — 1, 

(b) SiSj = SjSi, |i-j|>l, (2.4) 

(c) SiS i+ iSi = Si+iSiSi+i, 1 < i < k - 2. 

The Brauer algebra B/%(x) C RBk(x) contains Sk and is generated by Sj and ij subject to relations 
(|2.4p and the following: 

(a) t, 2 = + l)ti, 1 < « < A; — 1, 

(b) Utj = tjti and tiSj = Sjti, \i — j\ > 1, 

(c) Usi = Siti =U, 1 < % < k - 1, (2.5) 

(d) t i t i ± 1 t i = U, 1 < i < k — 1, 

(e) stfi±iti = Si±iti and iA±iSj = t»Sf±i, 1 < i < fc - 1, 



i-l i i+li+2 fe 

ixi:::i 
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The rook monoid C RBk(x) is generated by Sj and p, subject to relations (|2.4p and the following 
relations: 

(a) pj=Pi, l<i<k, 

(b) PiPj=PjPi, i^j, 

(c) s^j = Pi+iSj, 1 < i < fe - 1, (2.6) 

(d) SiPj =PjSi, > 1, 

(e) PjSiPj = PiPi+i, 1 < i < k - 1. 

Finally, the rook-Brauer algebra RB^(x) is generated by Sj,ij, and pi subject to relations (|2.4p . 
(|2.5p . and (j2.6|) along with the following relations: 

(a) tipj =Pjt h > 1; 

(b) Upi = tip i+1 = tiPip i+1 , l<i<k-l, 

(c) pjtj = = PiPi+iU, l<i<k—l, (2.7) 

(d) ijpji, = tj, 1 < i < k- 1, 

(e) piUpi = PiPi+i, l<i<k—l. 



3 Schur-Weyl Duality 

3.1 Tensor powers of orthogonal group modules 

Let GL n (C) denote the general linear group of n x n invertible matrices with entries from the 
complex numbers C, and let O n (C) = { g £ GL n (C) | gg l = I } be the subgroup of orthogonal 
matrices, where t denotes matrix transpose and / is the n x n identity matrix. We refer to [GW 
or [LR] for standard results on the representation theory of the orthogonal group. Let V(0) = C be 
the 1-dimensional trivial GL n (C) module and let V(l) = C n be the defining n-dimensional GL n (C) 
module on which GL n (C) acts as n x n matrices. Specifically, let vq be a basis for V(0) and let 
v%, . . . , v n be a basis for V(l), then for g £ GL n (C) we have gvo = vq and gvj = Y^=i9ij v ii where 
gij is the zj-entry of g. 

Then V = V(0) © V(l) is an (n + l)-dimensional GL n (C) module with basis vo,v\, . . . ,v n . 
Consider the /c-fold tensor product module 

V® fc = C-span{ v h © • • • ® Vi J ij £ {0, . . . ,n} } , (3.1) 

which has dimension (n + l) fc and a basis consisting of simple tensors of the form i% ® • • • ® Vj. . 
An element g £ GL ra (C) acts on a simple tensor by the diagonal action 

g{v h ® ■ ■ ■ ® v ik ) = {gv h )® ■ ■ ■ <g> (gv ik ), (3.2) 

which extends linearly to make V® fc a GL n (C) module. 

The irreducible polynomial representations of O n (C) are of the form V A where A = (Ai, A2, • • • , A^) 
is a partition with X[ + A' 2 < n. In this notation V(0) = V and V(l) = V^ 1 ) = V n . The Clebsch- 
Gordon formulas give the following tensor product formulas, 

V A V = V A and V A © V (1) = V\ (3.3) 

)i=X±D 

and thus, 

V A tg>V = 0V^, (3.4) 

A' 
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where the sum is over all partitions [i such that either \x = A or /i = A ± □. By convention, we 
define V®° = V . 

Let Ahr denote the fact that A is an integer partition of r, and for k > 0, define 

A fc = {Ar-r|0<r<fc}. (3.5) 

Define the Bratteli diagram B of O n (C) acting on V® fe to be the infinite rooted lattice with vertices 
on level k labeled by the partitions in and an edge between fj, G Afc_i and A G A& if and only if 
one of the following three conditions hold: A = fi, A = fj, + □, or A = fj, — □. Thus the first 4 rows 
of B are given by 

sum of squares 



V®° 1 




By this construction, we see that A& indexes the irreducible O n (C) modules which appear in V® fc . 
Furthermore, if we let m£ denote the multiplicity of V A in V® fc , then by induction on the tensor 
product rule Q3.4p . we see that 

m£ = (the number of paths of length k in B from G Ao to A G A&). (3-6) 
3.2 Centralizer of 0„(C) on V® fc 

Let Cfc = Endo n (c)(V® fc ) be the centralizer of O n (C) acting on V® fe , so that 

C k = | cj) G End(V® fe ) | <P(yw) = ycp{w) for all y G O n (C), u; G V® fe } . (3.7) 

6 



Then by the classical double-centralizer theory (see for example [HR| or \CR\ Sees. 3B and 68]), we 
know the following. Let \ = mult v <8k(V A ) denote the multiplicity of V A in V® fc . Let dim(V A ) = 
P\(n) be the El-Samra-King polynomials (see Section 4). We have, 

• Ck is a semisimple associative C-algebra with irreducible representations labeled by A*.. We 
let { I A h r, < r < A;} denote the set of irreducible C^-modules. 

• dim(M^) = m\. 

• We can naturally embed the algebras Co Q Ci C C2 • • • , and the edges from level k + 1 to 
level k in B represent the restriction rule for C/% C C^+i. Therefore, B is the Bratteli diagram 
for the tower of semisimple algebras . 

• The tensor space V® fc decomposes as 

k 



y ®k ml V A as an O n (C)-module, 

r=0 Ahr 
k 

~ P ^ n ) M k as a Cfc-module, (3.8) 

r=0 Ahr 
k 

~ ( VA ® M k) as an (°™( C )' C fc )-bimodule. 



r=0 Ahr 

Note that it follows from these expressions that 

k 

(» + 1 )" = EE P ^)4 (3-9) 

r=0 Ahr 

• By general Wedderburn theory, the dimension of is the sum of the squares of the dimensions 
of its irreducible modules, 

dim(C fc ) = £^(m£) 2 . (3.10) 

r=0 Ahr 

3.3 Action of RB/ C (n + 1) on tensor space 

Let K = C. For d in the set ~RBk of rook-Brauer /c-diagrams, we define an action of d on the basis 
of simple tensors in V® fc by 

d(v n ® • • • ® Vik ) = % ® • • • ® % > ( 3 - 1 x ) 

jl,—,3k 

where is computed by labeling the vertices in the bottom row of d with i\, . . . ,ik and the 

vertices in the top row of d with ji, ■ ■ ■ ,jk- Then 



eGrf 



such that the product is over the weights of all connected components e (edges and isolated vertices) 
in the diagram d, where by the weight of e we mean 



8 a ,o, if s is an isolated vertex labeled by a, 
S a i), if e is an edge in d connecting a and 6, 
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and 5 a & is the Kronecker delta. For example, for this labeled diagram 



3i 32 33 34 35 3d 37 38 39 Jio 



d 




k 12 h U h k k h «9 ho 



we have 

^1,'. fc = ,33 ^32 M dj4,js ^35 ,36 ^37,k ^39 fi^jlO ,«8 ^1 ,»3 <^2 ,«6 ,0^7,U0 ■ 

The representing transformation of d is obtained by extending this action linearly to V® fc . 
Define s,t : V (S> V — !>V®V and p : V -> V on a simple tensors by 











Vb) 


n 












t- (« 


a® 


Vb) 


= ^o,6 X] Ufc C 






(3. 












fc=0 














P 


■ V a 










Then the representing action of 




and |?j 


under (|3.1ip is 


given by 






Si 


i — y 






3 S <& 


)idf" {4+1) , 


1 < i < 


k, 




U 


i — y 


idf" 






lid ®*-(i+D j 


l<i< 


k, 


(3. 


Pi 


i — ^ 


id^ 




$p<2 




1 < i < 


k. 





respectively, where idy : V — > V is the identity map. The action of the symmetric group generators 
Si by tensor place permutation is the same as in classical Schur-Weyl duality. The action of ti is 
the same as defined by R. Brauer [Br] for the Brauer algebra, and the action of the pi is the same 
as defined by Solomon [So] for the rook-monoid. 



Proposition 3.14. The map ir^ : RB fe (n + 1) -»• End(V® fc ) afforded by the action ([SXT]) of the 

basis diagrams is an algebra representation. 

Proof. It is possible to verify that the action of the generators f)3. 13|) satisfies the defining relations 
([ZlD - flgID - This is done in [MM] . To get the action on a general basis diagram (|3.1ip . one would 
then have to show that the action of the generators extends to (|3.1ip . Our approach is to use the 
diagram calculus to show that the action on diagrams satisfies diagram multiplication. That is, for 
diagrams d\ , cfe £ T&>k we show that 

= E (^)t:±(^)fc:±- 

We do so by considering the edges of d\di case by case. 

Case 1: Isolated vertices. If there is an isolated vertex in column r of the top row of d\, then both 
(ditfc)! 1 ''"'/* and (di)i 1, "' , i k (d2)^ 1, "'j k contain &„ n for all choices of £%,... ,£u- On the other hand, 
an isolated vertex in d\d2 occurs when a vertical edge in d\ is connected to a series of horizontal 
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edges (possibly of them) in the middle row of d\d% which end at an isolated vertex in the middle 
row of d\di- For example, 




Sequentially label these vertices v a , v ai , v a3 , . . . ,v at , as shown in the diagram above. Then 

(di<fa)il'~fi* contains 5 afi and (rfi)^"^*^)^'".^* contains 6 ' a , aAi,a 2 ■■■Sa t ,b$b,0 which equals S a ,o 
when a\ = ■ ■ ■ = at = b = 0. The proof for when the isolated edge is in the bottom row of d\d2 is 
analogous. 

Case 2: Horizontal and vertical edges. A vertical edge in d\d2 occurs when a vertical edge in di 
is connected to a vertical edge in d\ by a series of horizontal edges (possibly 0) in the middle row 
of d\d2- A horizontal edge in top row of d\d2 results from a horizontal edge in t\ or two vertical 
edges in d\ connected by a series of horizontal edges in the middle row of d\di- For example, 




Va 3 V ai V a2 V a4 V a5 V ae 



Label the top vertex in d\ with v a and sequentially label the connected vertices with v ai , v a2 , . . . , v at , v& 
as shown in the above diagrams. Then (dido)! 1 ' contains 5 a h and (d\ )i] '"''i k (d2) ; k contains 
<5a,ai <5ai ,a 2 ' ' ' $a t ,b which equals 5 a ^ when a\ = 02 = • • • = at = b. The proof for when the horizontal 
edge is in the bottom row is analogous. 

Case 3: Loops. A loop in the middle row of d\d<i results from a series of horizontal edges in the 
middle of d\di- For example, 




Starting with the left most middle vertex, label the vertices v ai , v a2 , . . . ,v at . When multiplying 
d\d2 in RBfc(ra) the inner loop is removed and the product is scaled by n + 1 (see (|2.2p ). On the 
other hand, the coefficient (di)^'"*'^ (d2) i \'"'\ k contains S ai ,a 2 ^a 2 ,a i • • • ^o t ,oi which is equals 1 when 
a\ = a2 = ■ ■ ■ = at is any of the n + 1 values in {0,1,..., n} and is otherwise. □ 

Proposition 3.15. The representation ir^ : RBfc(n + 1) — > End(V® ) is faithful for n > k. 

Proof. Suppose there exists some nonzero y = YldeRB k a dd £ Ker(-7Tfc). Choose a diagram d' in the 
linear combination for y such that 

(i) a d > / 0, 

(ii) among the diagrams satisfying (i), d! has a maximum number of vertical edges m, and 

(iii) among the diagrams satisfying (i) and (ii), d' has a maximum number of horizontal edges I. 



9 



Now, consider the simple tensor u such that (i) vo is in the positions of the isolated vertices in 
the bottom row of d', (ii) vi, v 2 , . . . ,v m are in the positions of the bottom vertices of the vertical 
edges in d' , and (hi) v m+ i, v m+2 , ■ ■ ■ , Vm+t are in the positions of the vertices of the horizontal edges 
in the bottom row of d! such that the subscripts of the vectors in the positions of either end of 
a horizontal edge are the same. Similarly, consider the simple tensor v! such that (i) vq is in the 
positions of the isolated vertices of the top row of d', (ii) Vi, v 2 , . . . , v m are in the positions of the 
top vertices of the vertical edges in d', and (hi) v m+1 , v m+2 , . . . , v m+s are in the positions of the 
vertices of the horizontal edges in the top row of d! such that the subscripts of the vectors in the 
positions of either end of a horizontal edge are the same. 

For example 

v! : v 5 v 5 v 2 v vi v 6 v 7 v 7 v 6 v 3 v v v 4 
/• \ \S * * • • 




u: v 5 v 5 vi v 6 v 7 v 7 v 6 v 2 v 3 v 4 v 8 v 8 v 

Note that the hypothesis n > k guarantees that such simple tensors u and u' exist. 

By this construction, the simple tensor v! has coefficient 1 in the expansion of d' ■ u. We claim 
that no other diagram with nonzero coefficient in y will act on u with a nonzero coefficient of v! . In 
order for another diagram d" in y to possibly produce a nonzero coefficient of v! when acting on u, 
d" must have the same bottom row as d! . This follows from the choice of d! having the maximum 
number of vertical edges and horizontal edges and choosing distinct Vj to put in each position of 
the edges of d! . The same conditions force the top row of d' and d" to be the same. Therefore, 
d" = d' and thus y ■ u ^ 0, which contradicts the assumption that y E Ker(7Tfc). Thus Ker(-7Tfc) = 
and 7Tfc is faithful. □ 

Theorem 3.16. Let p ym : O n (C) -»■ End(V® fc ) denote the representation o/O n (C) on V® fc . Then 
vr fc (RB A .(n + 1)) and p ycS k(O n (C)) commute in End(V® fe ). Thus, 7r fc (RB fe (n + 1)) C End On ( C )(V 0fe ) 
and p vm (O n (C)) C End RBfc(n+1) (V® fe ). 

Proof. The elements ^,Sj,p,(l < i < k, 1 < j < k) generate RBfc(n). Let g G O n (C) have matrix 
entries <jy so that g ■ v j = Y17=i 9ij v « an( ^ 9 ' v o = v o- The fact that gg T = I n since g E O n (C) tells 
us that Yle=i9U9jt = From (|3.12p and (|3.13p we see that Sj,tj act only on tensor positions i 
and i + 1 and pj acts only on tensor position j (i.e., these generators act as the identity elsewhere), 
so it is sufficient to verify that g commutes with s and t on V <g> V and that g commutes with p 
on V. These are straight-forward calculations and we provide one illustrative calculation here. Let 
1 < a, b < n. Then 



n n n 



gt • (v a (8) Vft) = <5 ab ^(vf g) v^) = (5 af) (v 8) v ) + 5 ab 9U9ji{^i ® Vj) 

£=o £=i i=i i=i 

n n 
= ^ab(vo 8) V ) + <5 ab ^(vi (8) Vj) = 5 a6 ^J(Vj (8) Vi), 

8=1 1=0 

n n n 
iff • (V a <8> V b ) = gia9jbt(vi ® Vj) = gia9ibt(vi (8) Vi) 

i=l jr'=l i=l 
n 

= <W(v» <8 Vj) = <5 afe y^(vj (8 Vi), 
^=o 
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The cases where a = or b = are even easier to verify and they must be considered separately 
since g acts differently on vo- □ 

The previous theorem gives a faithful embedding of RBfc(n + 1) in Endo n (c)( v '® fc ) for n > k. 
In the next section, we prove that the dimension of the centralizer algebra equals the dimension of 
RBfc(n + 1) and therefore 

RB k (n + 1)<* End „( C )(V® fc ), n> k. (3.17) 
3.4 RSK insertion, paths, and vacillating tableaux 

For A G Afe we define a rook-Brauer path (or simply a path) of shape A and length k to be a path 
of length k in the Bratteli diagram B from G Ao to A G A*. These paths exactly correspond 
to sequences (A , A 1 , . . . , \ k ) of integer partitions such that (i) A = 0, (ii) \ k = A, and (iii) A' i+1 
is obtained from X 1 by adding a box (A ,+1 = X 1 + □), removing a box (A J+1 = A* — □), or doing 
nothing (A J+1 = A 1 ). As an example, the following is a path of shape A = (2) and length k = 14, 



□ .□,0 J n,m,HH,H,H,bM>= J tT J .bH u ,cm,m 



These paths are very closely related to the vacillating tableaux studied in [HLj and [CDDSY] , Let 
7fc(A) denote the set of paths of shape A and length k. Then from f|3.6|) we have 



|T fc (A)| = ml = dim(M£) = mult v ® fc (V(A)). 

The rook-Brauer diagrams in this paper are special cases of the set partition diagrams in the 
partition algebra defined in [Ma], [Jo] - In [HL| . a Robinson-Schensted-Knuth insertion algorithm 
is given that turns set partition diagrams to pairs of paths in the Bratteli diagram of the partition 
algebra. When the algorithm is restricted to rook-Brauer diagrams, at each step we either add a 
box, remove a box, or stay the same, and thus we obtain a bijection between rook-Brauer diagrams 
and pairs of rook-Brauer paths (S, T) of shape A G A& and length k. We illustrate this bijection in 
Example 13.191 below. 

Our bijection gives us the following dimension formula, 

k k 

dim(RB fe (x)) = |72B fc | = EE IW)| 2 = EE^)' = dim(End „( C )(V^)), (3.18) 

r=0 Ahr r=0 Ahr 

which completes the proof of (13.17j) . 

Example 3.19. In this example, we illustrate the bijection of [HL] that turns rook-Brauer diagrams 
into pairs of rook-Brauer paths. First we label our diagram 1, . . . , k in the top row and 2k, . . . ,k + l 
in the bottom row and unfold our diagram to put it in a single row: 

1 2 3 4 5 6 ^ 



>£7, 




12 11 10 9 8 7 1 2 3 4 5 6 7 8 9 10 11 12 

We then label each edge in the diagram by 2k — i + 1, if i is the right endpoint of the edge. 
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If vertex i is the left endpoint of edge a, we let Ei = at, if vertex i is the right endpoint of edge 
a, we let Ei = clr, and if vertex i is not incident to an edge, we let Ei = 0. In this way we get an 
insertion sequence of the form, 

(E U E 2 , ...,E 2k ) = (3 L , 9 L , 1 L , 9 R , 4 L , 0, 5 L , 5 R , 4 fll 3 fl , 0, 

Now let = and recursively define 

rW= U^T^ 1 ), if^ = a L 
v 

where RSK denotes Robinson-Schensted-Knuth column insertion and jdt denotes jeu de taquin 
(for details on these well-known combinatorial algorithms see [HL] and the references therein). In 
our running example, we insert and delete as follows: 



1) 


3l 


RSK 
> 








5z 


RSK 
> 


i 


4 5 


H 




j_ 




2) 


9l 


RSK 
> 


3 


9 


8) 


5 R 


jdt 


i 

_3_ 


4 


3) 


1l 


RSK 
> 


1 


9 


9) 


4i? 


jdt 


T 

_3_ 




4) 


9r 


jdt 


T 

_3_ 




10) 


3 R 


jdt 


H 




5) 


4l 


RSK 
> 


1 

_3_ 


4 


11) 







H 




6) 







1 


4 


12) 




— 







We then take the first k shapes and the last k shapes (reversed) to be our pair of paths 

p = (0, □ , m , EP , B , EF , EP), 
q = (0, □ , □ , B , BP . EF . F )• 

3.5 Semisimplicity of RB^rc) for generic x G C 

The coefficients of the relations in the presentation of RBfc(a;) are polynomials in x, and RBfc(x) 
is semisimple for each x G Z with x > k (i.e., infinitely many). Thus, it follows from the Tits 
deformation theorem (see for example |HRt Theorem 5.13] or \CH\ 68.7]) that 

(a) RBfc(x) is semisimple for all but a finite number of x G C. 

(b) If x G C is such that RBfc(x) is semisimple, then 

(a) Afc is an index set for the irreducible RBfc(x)-modules. 

(b) If M£ is the irreducible RB,fc(j;)-module labeled by A G A^, then dim(V A ) = m£. 
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4 Seminormal Representations 



Throughout this section let K = C and let x G C be chosen such that RBfc(x) is semisimple. 
We explicitly construct RBfc(x)-modules M^, for each A E These representations have bases 
labeled by the paths to A in the Bratteli diagram and they are generalizations of the seminormal 
representations of the symmetric group (due to Young |Yoj ) . of the Brauer algebra (due to Nazarov 
[Nz| and Leduc and Ram |LR| ) . and of the rook monoid algebra (due to Halverson |Ha| ). The 
matrices of the representations that factor through the symmetric group are orthogonal with respect 
to this basis. 

We give explicit actions of our generators pi,ti,Si on the path basis, and we show that if x 
is chosen so that RBfc(x) is semisimple, then the modules form a complete set of pairwise 
nonisomorphic representations. Furthermore, as shown in (|4.14p the seminormal bases constructed 
here as paths in the Bratteli diagram explicitly realize the restriction rules given by the Bratteli 
diagram. This is a defining feature of a seminormal basis as discussed in [Raj. 



4.1 El-Samra King Polynomials 

For a partition A, the dimension of the irreducible n (C) module V A is given by the El-Samra King 
polynomial [El-Kj (see also |LR} (6.21)]). These polynomials occur in the matrix entries in the 
seminormal representations of RB n (x) that we determine below. For a partition A let Aj denote the 
length of the ith column and let X'j denote the length of the jth column. Define the hook of the 
box at position € A to be 

h(i,j) = Xi -i + X'j -j + 1. 

and, for each box G A define 

"(M)={ A \T A vi"i +1, 1 i". 1 <"> 

{-X't-X'j + i + j-l, d%>j. 
The El-Samra King polynomials are given by 

*m - n x - z Uf A - < 4 - 2 > 

and the irreducible O n (C)-module V A has dimension given by [El-K 

dim(V A ) = P\(n). 



4.2 Action of generators on paths 

In this section we describe the action of each of our generators U, Si,pi of RBfc(x) on a basis indexed 
by the paths 7fe(A) defined in lSection 3.41 For each A 6 Afe, let { V5 | S £ 7fc(A)} be a set of linearly 
independent vectors indexed by 7fe(A), and let 

= C-span{ v T | T e 7*(A) } 

be a vector space spanned by these vectors. 

If S = (A , A 1 , . . . , X k ) G T k (X), then for each 1 < j < k define 

Pj • v 5 = < . (4.3) 

0, otherwise. 
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Observe that the action of pj depends only on the shapes in positions i — 1 and i of S. 

For 1 < i < k, the action of the generators ij and Sj depend only on the partitions in positions 
i — 1, i, i + 1 of a path 5 G 7fc(A). For this reason, we use the notation, 

if S = (A°,...,A fc ) then S< = (A i_1 , A*, A m ), < i < k. 

Furthermore, we say that a pair of paths S = (A , . . . , X k ) and T = (r°, . . . , T fc ) are i- compatible if 
ijJ = t 3 whenever j ^ i. That is, S and T can only differ in the ith position. We let denote 
the set of all paths that are i-compatible with S. Note that S G Ti(S), and if T € Tj (»!?), then S 1 
and T have the form 

5=(A(°)...,A( l - 2 ), 7 ,a,p,A^ 2 ),...,A( fe )), =* Si = ( % a,p), 
r=(A( )...,A( 4 - 2 ), 7 ,/3, P ,A^ 2 ),...,A( fe )), => T,= ( 7 ,/3,p). 

We will see that when Sj or ij acts on a path indexed by <S it stays within the span of the paths 
indexed by Ti{S). 

For 1 < i < k and S G 7fe(A) with Si = (7, a, p) define 

U-vs= E (*)t1>> (4.4) 
Ter^s) 

where the constant (i)T^ is given by 

_ , W-W-' l (4 . 5) 



such that <L 7 is the Kronecker delta and P\{x) is the El-Samra-King polynomial (|4.2p . The inter- 
esting form of this matrix entry, involving dimensions of orthogonal group modules, is explained 
in [LRj . The operator t acts as a projection onto the invariants in V V (see (|3.12p ). Leduc and 
Ram use the Schur-Weyl duality and a Markov trace on the centralizer algebra to prove in [LR, 
Theorem 3.12] that in a seminormal representation any projection onto the invariants in a tensor 
product centralizer algebra will have this form. The fact that x — 1 is used in place of x is because 
RBfc(n) is in Schur-Weyl duality wih 0(n — 1). 

Similarly, for S G 7fc(A) with Si = (7, define 



Si • v 5 



E ( 4 - 6 ) 



The constant (s)Z^p is more complicated. First, we have the cases where a = 7, a = p, f3 = 7, or 
f3 = p. These special cases are given by the following Kronecker deltas, 

WSJ = *Hp> ( s )J p = S v?> 00££ = <W> (sVZ = V (4-7) 

In particular, equation (j4.7j) says that if 5 and T are i-compatible and Si = (7, 7, p) and Tj = 
(.1,P,P), then 

• vs = vt and Sj • = V5. 
and in the special case where = (7,7,7) we have Sj • V5 = V5. 
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Now, assume that a / 7, a / /), and a//?. Then 



\~fOtpJ 



V(o(^)-i)(»(^)- 

_| y/P a (x-l)Pp(x-l) 



(s)^ = 'feL , (4. 



if p = 7, 



with (and the following definition holds for the special case a = (3), 

A/ 7 a P N . \±(ct(b) - ct(a)) , p = P± b and a = 7± a, 

{ryPp) \±(x-2 + ct(b) + ct(a)), p = /3±b and a = 7 T a, 

where A = p ± 6 indicates that the partition A is obtained by adding (subtracting) a box a from 
the partition p and where ci(a) is the content of the box a, namely 

ct(a) = j — i, if a is in row i and column j. 

Remark 4.11. ijf a segment of a path consists only of adding boxes, then the action of Sj on that 
part of the path corresponds to Young's seminormal representation of the symmetric group Sk found 
in \Yo\ REF]. If the segment consists of adding boxes and doing nothing then the action of Sj and pi 
on that part of the path corresponds to the seminormal representation of the rook monoid Rk found 
in ]Ha\ Thm. 3.2]. If the segment consists of adding and deleting boxes (but not doing nothing), 
then the action of Sj and t{ on that part of the path corresponds to the seminormal representation 
of the Brauer algebra B^(x) given in Nazarov \Nz\ Sec. 3] and Leduc-Ram \LR\ Thm. 6.22]. 

4.3 Seminormal representations 

For each A £ Aj, extend the action in (|4,3p . (|4.4p . (|4.6p linearly to and define an action of 
RBfc(a;) on by extending the action of the generators to all of RBfc(a;). 

Theorem 4.12. For each k > and each A £ A^, the actions ofpi,ti,Si given in f|4.3[) . (|4.4p . (|4.6p 

extend linearly to make an RBk(x) module. 

Proof. To show that is an RB fc (x)-module, we verify relations ([273]) .([23]). ff27T|) . Many 

of these verifications come for free from CS n ,B n (x + l),CR n and Remark 14. Ill The generators 
Pi, ti, Si act locally in the sense that they only care about the parts in positions i — i + 1 of the 
path, so (E3D(b), ([23])(b), (GL6])(b),(d), and ([277)1 (a) all follow from the fact that the generators 
commute when they are working on non-overlapping parts of paths. Furthermore, we only need to 
check the relations when we "do nothing" on one of these steps (that is, A 4-1 = A* or A* = A* +1 or 
both), since the other cases are handled in CS n , B n (x), and CR n . 

The symmetric group relations (|2.4p are proven on Brauer type paths in [Nz] and |LR| . These 
relations are easy to check on paths that do nothing at least once. As an example, we verify the 
braid relation (|2.4p (c) on one such path. We let (5, 5, 7, p) denote the path S = (A , . . . , X k ) such 
that (A* -1 , A*, A i+1 ,A i+2 ) = (8,8,7, p). Then, 

SiS i+ iSi(8,8,j,p) = SiS i+ i(8,j,j,p) =Si(8,j,p,p) = ^(s)^ p (8,a,p,p), 

a 

s i+ isis i+ i(8,8,j,p) = ^2(s) 5 s l P p s i+ iSi(8,8,a,p) = ^2(s) s s l P p s i+ i(6,a,a,p) = ^2(s) S s l P p (8, a, p,p). 
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In [LR] 3.12] a general formula for action of ij is given, since t is projection onto the invariants 
in V® V. The Leduc-Ram formula specializes in our case to 14.41 and the relations involving only ij's 
follows from the general principles in |LR] , Most of these relations are also easily verified directly. 
One subtlety is that when tj acts on a path (even on a path that has no do-nothings) the output is a 
sum of paths that includes paths that do nothing, and to verify the relations these do-nothing-paths 
need to be considered separately. As an example, we verify one of the more complicated relations 

race). 

Sit i+1 ti(~/,5,T,p) = 8 1>T } y tT^Sjtj+id, a, 7, p) = 8 7)T tl f p f s i ti +1 ('j,p,j,p) 

a 

= *r,r £ <ffit^*i(7, P, «, P) = V E E ^S(7. & «. P) 

»i+i*i(7, «5, r, p) = 5 7 ,r E ^7^+1(7, A 7, p) = <&y,T E E ^S 8 ?^ 7 ' & a ' P) 

Note in the first case that s 7 ^" = when a = p, and in the second case = if /3 = 7. So 
the sum is over all paths that always add or subtract boxes in these components, and thus the two 
calculations are equal because they are equal in the Brauer algebra [NzJ, [LR]. It is also possible to 



prove this directly using a case-by-case examination of the coefficients tjpftp^psjfj^ and tl^ s^Jf . 
The relations in (J2.6]) are straightforward. The most interesting one of them is ({2.6]) (c): 

SiPi{l, a, p) = 5 7 , Q Si(7, 7, p) = £ 7 , a (7> P> P) 

PiSi(j, a, p) = E tfjfipiil/, 0, p) = s 77 p(7 5 7, p) 

which are equal because s 77 p = 5 a)P (see (|4.7p ). The relations in (|2.7p are similarly straightforward, 
and we verify ({2.71) (c) as an example: 

tiPiU(rt,Ot,p) = Sy^p^t^tiPiij, = ^^^(7,7,7) = E *777*S (T'/ 3 '^)- 

Now OS = ^riS^^S^ = ^Sgg^ = « and so the dis P la ^ d 

sum equals ^(7, a, p). This proves that M£ is an RB^(x) module. □ 

For A G Afc let A^_ x = { // G Afc_! |/i = Aor/i = A±D} so that A^_ x is the set of partitions 
p G Afc_i that are connected to A G A& by an edge in B. Consider RBfc_i(x) C RBfc(x) to be the 
subalgebra spanned by pi for 1 < i < k — 1 and i,, Sj for 1 < i < k — 2. Equivalently, RB^^x) 
is spanned by the diagrams in TiBk having a vertical edge connecting fcth vertex in the top row to 
the /cth vertex in the bottom row. Now order the basis of in such a way that the paths that 
pass through p G A^_j are grouped together in the ordering, and let p^ denote the representation 
corresponding to the module with respect to this basis. Then since the action of RB^_i(x) does 
not see the last edge in the path to A, we have the following key property of a seminormal basis, 

Pk(d)= pLxW, fora]ldeRB fc _ 1 (x). (4.13) 



fi — X or fj,— Aid 



The restriction rules for RB&_i(x) C RB^(x) follow: 

RB fc (:r) 
3 RB fc _i(x) 



H«S:S.)(MJ)= © K-r (4-14) 



M£A fc _ 1 
-A or 11 — Aztn 
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and (|4.13p is an explicit realization of this decomposition on the basis level. 

Since the restriction rules (|4.14p distinguish each A, we see that ^= if 7 7^ A. Thus, we have 
constructed a set of nonisomorphic RBfc(a;)-modules indexed by with dimension dim(M^) = m\. 
When x E C is chosen such that RBfc(x) is semisimple, we know from lSection 3.5l that these modules 
have the same index set and the same dimensions as the irreducible RB/ c (x)-modules. Thus, they 
are irreducible, and we have proven the following theorem. 

Theorem 4.15. If x £ C is chosen so that RBk(x) is semisimple, then { | A € } is a complete 
set of irreducible RBfc(x) -modules. 
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